Goto

Collaborating Authors

 multiple loss


CDI: Copyrighted Data Identification in Diffusion Models

arXiv.org Artificial Intelligence

Diffusion Models (DMs) benefit from large and diverse datasets for their training. Since this data is often scraped from the Internet without permission from the data owners, this raises concerns about copyright and intellectual property protections. While (illicit) use of data is easily detected for training samples perfectly re-created by a DM at inference time, it is much harder for data owners to verify if their data was used for training when the outputs from the suspect DM are not close replicas. Conceptually, membership inference attacks (MIAs), which detect if a given data point was used during training, present themselves as a suitable tool to address this challenge. However, we demonstrate that existing MIAs are not strong enough to reliably determine the membership of individual images in large, state-of-the-art DMs. To overcome this limitation, we propose CDI, a framework for data owners to identify whether their dataset was used to train a given DM. CDI relies on dataset inference techniques, i.e., instead of using the membership signal from a single data point, CDI leverages the fact that most data owners, such as providers of stock photography, visual media companies, or even individual artists, own datasets with multiple publicly exposed data points which might all be included in the training of a given DM. By selectively aggregating signals from existing MIAs and using new handcrafted methods to extract features for these datasets, feeding them to a scoring model, and applying rigorous statistical testing, CDI allows data owners with as little as 70 data points to identify with a confidence of more than 99% whether their data was used to train a given DM. Thereby, CDI represents a valuable tool for data owners to claim illegitimate use of their copyrighted data.


FP-PET: Large Model, Multiple Loss And Focused Practice

arXiv.org Artificial Intelligence

This study presents FP-PET, a comprehensive approach to medical image segmentation with a focus on CT and PET images. Utilizing a dataset from the AutoPet2023 Challenge, the research employs a variety of machine learning models, including STUNet-large, SwinUNETR, and VNet, to achieve state-of-the-art segmentation performance. The paper introduces an aggregated score that combines multiple evaluation metrics such as Dice score, false positive volume (FPV), and false negative volume (FNV) to provide a holistic measure of model effectiveness. The study also discusses the computational challenges and solutions related to model training, which was conducted on high-performance GPUs. Preprocessing and postprocessing techniques, including gaussian weighting schemes and morphological operations, are explored to further refine the segmentation output. The research offers valuable insights into the challenges and solutions for advanced medical image segmentation.


Keras: Multiple outputs and multiple losses - PyImageSearch

#artificialintelligence

A couple weeks ago we discussed how to perform multi-label classification using Keras and deep learning. Today we are going to discuss a more advanced technique called multi-output classification. And how are you supposed to keep track of all these terms? You can even combine multi-label classification with multi-output classification so that each fully-connected head can predict multiple outputs! If this is starting to make your head spin, no worries -- I've designed today's tutorial to guide you through multiple output classification with Keras. It's actually quite easier than it sounds. That said, this is a more advanced deep learning technique we're covering today so if you have not already read my first post on Multi-label classification with Keras make sure you do that now. From there, you'll be prepared to train your network with multiple loss functions and obtain multiple outputs from the network.